(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(11) 



EP 1 045 573 A2 



(12) 



EUROPEAN PATENT APPLICATION 



(43) 


Date of publication: 


\o i ) int. ci. : nuH-iN i/ £ fui 




18 10 2000 Bulletin 5000/4? 


(21) 


Application number: 00201248.2 




(22) 


Date of filing: 05.04.2000 




(84) 


Designated Contracting States: 


(72) Inventors: 




AT BE CH CY DE DK ES Fl FR GB GR IE IT U LU 


♦ Gallagher, Andrew C, 




MC NL PT SE 


Eastman Kodak Company 




Designated Extension States: 


Rochester, New York 14650-2201 (US) 




AL LT LV MK RO SI 


• Gindele, Edward B., 


(30) 




Eastman Kodak Company 


Priority: 16.04.1999 US 293197 


Rochester, New York 14650-2201 (US) 


(71) 


Applicant: EASTMAN KODAK COMPANY 


(74) Representative: 




Rochester, New York 14650 (US) 


Lewandowsky, Klaus, Dipl.-lng. et al 






Kodak Aktiengesellschaft, 






Patentabteilung 






70323 Stuttgart (DE) 



CM 
< 
CO 

LO 

o 



(54) A method for compensating digital images lor light falloff and an apparatus therefor 



(57) A method for compensation at least one digital 
image for light falloff. The digital image may be gener- 
ated for example from a conventional image frame on a 
film roll. A plurality of pixel values is provided for each of 
at least one digital image. A light falloff compensation 
function is applied and according to tat a light falloff cor- 
rection parameter is determined. Both the light falloff 
compensation function and the light falloff correction 

12 



parameter are used to generate an individual compen- 
sation value for each pixel element. The compensation 
value is applied to each pixel element. The method is 
also able to differentiate and correct the images accord- 
ing to light falloff generated by pure lens falloff or a light 
falloff generated by the lens and the flash falloff. 
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Description 

[0001] The invention relates generally to the field of digital image processing and, more particularly, for compensat- 
ing an image for light falloff. The light fall off may be a composed of iens and/or flash falloff. 
5 [0002] Lenses produce non-uniform exposure at the focal plane when imaging a uniformly lit surface. For instance, 
the light from a uniformly lit gray wall perpendicular to the optical axis will pass through a lens and form an image Jhat 
is brightest at the center and dims radially. The intensity of light in the image will form a pattern described by cos of 
the angle between the optical axis, the lens, and the point in the image plane. 

[0003] In addition, other factors such as vignetting contribute to the lens falloff phenomena. Vignetting is a property 
10 that describes the loss of light rays passing through an optical system. 

[0004] In the traditional optical photographic system, every image captured on a negative contains some compo- 
nent of lens falloff. The lens of an optical printer also introduces lens falloff during the printing process. However, this 
falloff occurs to the negative of the original scene, and thus has the effect of providing a means of partial falloff compen- 
sation. 

75 [0005] Digital printers have no such built in falloff compensation. In fact, digital printers are calibrated such that a 
uniform field is produced by printing an image of uniform code values. Consequently, a need exists for a method of com- 
pensating a digital image for the lens falloff that occurred at the time of image capture in a similar manner to the tradi- 
tional photographic printer. 

[0006] In general, the level of falloff compensation corrected by the optical printer is less than the amount of falloff 
20 that the optics of the capture device cause. For this reason, there is a need to compensate specifically for the falloff that 
the capture system induces into the captured scene. 

[0007] Several examples exist in the prior art which teach methods of compensating an image for the lens falloff 
that occurred at the time of capture. In U.S. Patent No. 5,461 ,444, Toyoda et al describe a method of recording camera 
identification code onto the film upon which the image is also captured. This identification code specifies the lens infor- 
ms mation (focal length, focus position, and aperture value). During digital processing, the identification code is translated 
by look-up-table to a required level of correction which is applied to the image. 

[0008] However, it is not always practical or possible to record such information onto photographic film. Conse- 
quently, the need exists to compensate for levels of lens falloff in a captured scene with less knowledge about the cam- 
era's optical system at the time of image capture. 
30 [0009] In addition, when a flash is used in order to provide more illumination on a scene, there is often observed in 
the output image an effect similar to lens falloff. Consequently, there exists a need to create a flash falloff compensation 
for those scenes where flash falloff degrades image quality. 

[0010] Consequently, a need exists for overcoming the above-described drawbacks. More specifically, a need 
exists for applying a lens and flash falloff correction without the need of the knowledge of the specific focal length, aper- 
35 ture, and focus position. 

[001 1] It is the object of the present invention to provide a method directed to overcoming one or more of the prob- 
lems as set forth above. Briefly summarized, according to one aspect of the present invention, the invention resides in 
providing a correction of the light falloff without the need to provide specific data about the focal length, the aperture and 
the focus position of the picture taking device. 
40 [0012] The object stated above is accomplished by a method for compensating at least one digital image for light 
falloff comprising the steps of: 

• providing a plurality of pixel values for each of at least one digital image; 

• providing a light falloff compensation function; 
45 • determining a light falloff correction parameter; 

• using the light falloff compensation function and the light falloff correction parameter to generate an individual com- 
pensation value for at least one pixel value; and 

o applying the individual compensation value to at least one pixel value. 

so [0013] It is a further object of the present invention to provide an apparatus which outputs at least one image com- 
pensated for light falloff. The method is accomplished by an apparatus for compensating at least one digital image for 
light falloff, the apparatus comprises: a digitizing device to provide at least one digitized image frame; a light falloff com- 
pensator for applying an individual compensation value to at least one pixel element; a light falloff compensation mask 
Is generated by a light falloff compensation function and a light falloff correction parameter to generate the individual 

55 compensation values for each pixel element; and a rendering device for providing a visual representation of an image 
compensated for light falloff. 

[0014] These and other aspects, objects, features and advantages of the present invention will be more clearly 
understood and appreciated from a review of the following detailed description of the preferred embodiments and 
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appended claims, and by reference to the accompanying drawings. 

[0015] The subject matter of the invention is described with reference to the embodiments shown in the drawings. 

Fig. 1 is a schematic representation of the system providing falloff free pictures; 
5 Fig. 2 is a representation of the components of the failoff mask generator from Fig. 1 ; 

Fig. 3 is a simplified two-dimensional representation of the plurality of pixel elements responsible for the image con- 
tent; 

Fig. 4 is a schematic set-up for the calculation of the lens falloff; 
Fig. 5 is a normalized, one-dimensional representation of the lens falloff; 
io Fig. 6 is a graphical representation of the determination of the light falloff correction value according to the aver- 
aged frame of an entire film roll; 

Fig. 7 is a graphical representation of intensity distribution in an average frame; 
Fig. 8 is a graphical representation of intensity distribution in a symmetric average frame; 
Fig. 9 is a graphical representation of a fitted cos 4 surface in order to provide the fit-parameter f\ 
15 Fig. 1 0 is a graphical representation of a light falloff compensation mask, which is applied to the pixel values of each 
image frame on a film roll; 

Fig. 11 is a real image before a compensation for light falloff is carried out; and 
Fig. 1 2 is a real image after the compensation for light falloff is carried out. 

20 [0016] In the following description, the present invention will be described in the preferred embodiment as a 
method. Those skilled in the art will readily recognize that the equivalent of such a method may also be constructed 
within the scope of the invention. • 

[0017] • Referring to Fig. 1 , there is illustrated an overview of the present invention. It is instructive to note that the 
present invention utilizes at least one digital image 2 which is typically a two-dimensional array of red, green, and blue 

25 pixel values, or a single monochrome pixel value corresponding to light intensities. The digital image 2 is in the form of 
digital image data (see Fig. 3), which are used for further processing. A digital camera (not shown) may be the source 
for digital image 2. In addition to that the digital image 2 may be generated from a conventional film roll 12, like the 
Advanced Photo System (APS), 35 mm film or any other film format. Therefore, at least one film frame 3 of the film roll 
12 is subjected to a digitizing device 14. The digitizing device 14 may have the form of a film scanner which transforms 

30 each of the frames on the film roll 12 into a digital representation thereof. The digital device 14 may also be the image 
sensor of a digital camera or even a flatbed scanner for digitizing positive prints. The so generated digital image data 
are fed to a falloff compensator 10. After the compensation of the falloff, a rendering device 16 displays or prints the 
falloff compensated image 4. The rendering device may take several forms which are suitable to display or print the fal- 
loff compensated image 4. The rendering device may be a display, a CRT tube, a digital printer, an inkjet printer, or a 

35 combination therefrom. 

r [0018] The metric of the image data described by this invention is assumed to be log exposure. An alternative 
embodiment of the present invention may be implemented if the metric of the image data of the input image is in fact 
linearly related to exposure. 

[0019] As explained below, the light falloff may have its origin in a lens falloff and, if a flash is used during picture 
ao taking, also in a flash falloff. The light falloff in at least one digital image 2 is compensated by carrying out alterations on 
at least one pixel value of one digital image 2. At first, a plurality of pixel values of one digital image 2 has to be provided. 
As mentioned above various film roll types (Advanced Photo System or 35mm) may be used. A light falloff compensa- 
tion function fcf is provided and at least a light falloff correction parameter f is calculated to generate a light falloff com- 
pensation mask, which provides the best light falloff compensation. Additional parameters may have an influence on the 
45 light falloff compensation and are discussed in the various embodiments of the invention. For a more detailed descrip- 
tion of the parameters see the specification below. The light falloff compensation function fcf and the light falloff correc- 
tion parameter f enables a calculation of a compensation value for each pixel element pij of the digital image 2. It is clear 
for a person skilled in the art, that there is no need to apply the compensation value to each pixel element Pij. The com- 
pensation value can be applied to selected pixel elements. In the following description the compensation value, individ- 
50 ual for each pixel pij, is applied to each pixel element pij and the result is a light falloff corrected image. As described 
later, there is also the possibility to calculate the compensation value for each pixel element pij according to a light falloff 
compensation function fcf which comprises uniform areas bigger than the a single pixel of the digital image generation 
device. It is clear that a reduction in the number of pixels being subjected to the calculation process saves processing 
time. 

55 [0020] To carry out the process, the digital image data of the digital image 2 is passed into the falloff compensator 
1 0. The falloff compensator 1 0 performs a pixel by pixel summation of the input image data with the corresponding com- 
pensation value for each pixel element pij generated by the falloff mask generator 20 by evaluating the light falloff com- 
pensation function fcf. In other words, the light falloff compensation function fcf is evaluated to produce a light fajloff 
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compensation mask, defined as a two-dimensional representation of compensation values to be applied to the respec- 
tive pixel elements pij of the digital image 2. Pixel by pixel addition or multiplication is well known in the art and will not 
be further discussed. Accordingly, the resulting output from the falloff compensator 1 0 has been compensated for light 
falloff. As mentioned above the light falloff in the original image may be caused by lens falloff, flash falloff or a combina- 
tion of both. 

[0021] Referring to Fig. 2, therein is illustrated a more detailed view of the falloff mask generator 20. The light falloff 
compensation function fcf is designed to be symmetric about the horizontal and vertical axes of the original image. The 
light falloff compensation function fcf is a composite of two falloff compensation functions, each compensating for a spe- 
cific source of falloff. A first falloff compensation function compensates for lens falloff. The lens falloff compensation 
function (fcf is generated by a lens falloff function generator 30. A second light falloff compensation function compen- 
sates for flash falloff. The flash falloff compensation function ffcf and is generated by a flash falloff function generator 40. 
[0022] Both, the lens falloff compensation function, ffcf, and the flash falloff compensation function, ffcf, may be 
described mathematically as functions of the position in the original image. Both the lens falloff compensation function 
tfcf and the flash falloff compensation function ffcf are evaluated for the number of lines and pixels as the original image 
passed to the falloff compensator 1 0. 

[0023] In the preferred embodiment the lens falloff compensation function tfcf is defined- in equation 1. Practically, 
in a camera system with lenses, the falloff results in non-uniform exposure to the film or image sensor. The necessary 
parameters for calculation of the falloff at each position on a film plane or image plane is shown in Fig. 4. A lens 50 
images a scene onto the film frame 3 or an image sensor 52. A maximum angle @ max occurs in each corner 54 of the 
film frame 3 or the image sensor 52 and is known as the semi-field angle. For any given camera, the maximum angle 
®max (equation 2) may be calculated as: 

Ifcf = -[1 000 log 10 cos 4 ©] Equation 1 



©max = tan " 1 (7) Equation 2 



where: 



f is an additional parameter and in some cases it can be the focal length of the lens used to image the scene ontD 
the film frame 3 or image sensor 52. c is the diagonal distance from a center 53 of the film frame 3 or image sensor 
52 to the corners 54 thereof. The ratio of exposure in a corner 54 of the image to the exposure on an optica! axis 
56 defined by the imaging lens 50 is expressed in equation 3. A one-dimensional plot of equation 3 is shown in Fig. 

5. • 



=cos 



1(0) 



4 |W 1 (jJ Equation 3 



where L(0 max ) is the exposure in the corners 54 of the film frame or the image sensor 52 and L(0) is the exposure in a 
center of the film frame or the image sensor 52 defined by the optical axis 56. 

[0024] Table 1 shows an evaluation of the expression in equation 2 for some different camera systems. 
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23 
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0.64 


0.41 


1.3 


386 


Table 1 : cos 4 faT 


off in common cameras 



[0025] The 4th column of data in Table 1 shows the estimated relative exposure resulting from identical radiances 
20 imaged through the optical lens 50. The remaining columns all display that same data in other metrics. The 5th column 
shows the falioff in terms of photographic stops. Merely because of the lens falloff, the corners of a film frame 52 in a 
Single Use Camera (SUC) is over 1 stop down from the center of the image. This value is convened to logE by convert- 
ing with the factor 300 logE/stop. 

[0026] In most prints, the result of this falloff is not easily detected on a single stimulus basis. There are several rea- 
25 sons for this. First, the falioff occurs as a very low spatial frequency. For a 4 inch x 6 inch print, the falloff is in the range 
of 0.10 cycles/inch to 0.05 cycles/inch (at standard viewing distance of 14 inches this becomes 0.025 cycles/degree to 
0.014 cycles/degree.) The human eye is not especially sensitive to frequencies in this range. Most scenes with a mod- 
erate amount of detail will hide the falloff from human perception. However, the falloff is often noticeable in photographs/ 
of a clear blue sky (see Fig. 11). The corners of the image will appear in a much darker blue than the sky nearer the 
30 center of the print. In such cases, the falloff is quite obvious and objectionable. 

[0027] Another reason that photographic prints often do not appear to have falloff is a result of the optical printing 
process. The optical printer also contains a lens with geometric falloff. Because this lens falloff occurs to the negative, 
the overall effect of the falloff incurred by the printing process will partially compensate for the falloff generated by the 
lens or optical system of the camera. If the falloff profile of the printer lens exactly matches the falloff profile of the cam- 
as era lens, a system free of lens falloff will result. However, the L(@ max )/L(0) ratio is typically about 0.85 for a conventional 
photographic printer. This means that the majority of cameras introduce more falloff into the imaging process than the 
printer is capable of correcting. 

[0028] A digital printer requires a correction of the image signals for light falloff before the image is printed on a 
receiving medium. The digital correction for the lens falloff is done with equation 1. Here, an individual compensation 
40 value is calculated for every pixel of the image passed to the falloff compensator 1 0. Where 

0=tan- 1 Q 

45 

d is the distance in pixels of a particular point from image center 5. f is an additional parameter, in some cases it is the 
focal length in pixels of the imaging Jens 50. As shown below, f can also be a fit parameter. In this case a plurality of film 
frames are used to find an averaged light falloff compensation function, thereby f is varied to provide the best fit for the 
overall light falloff compensation function, d is calculated according to equation 4. The distance d is measured in pixels. 

50 




Equation 4 



55 



x is the coordinate of the pixel in the x-direction of the digital image 2 and y is the coordinate of the pixel in the y-direc- 
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tion of the image 2. x max and y max are the maximum dimensions of the digital image 2 in the x-and y-direction respec- 
tively. 

[0029] As mentioned above the digital image 2 is represented by a two-dimensional array of red, green, and blue 
pixel values. Fig. 3 is a simplified representation of the two dimensional of the plurality of pixel elements pij. Here i is the 

5 number of a pixel in the x-direction and j is the number of a pixel in the y-direction. For the sake of simplicity only one 
type (for example the blue one) of pixel elements pij is considered. A center 5 is defined in each digital image 2. The 
distance d from the center 5 is calculated according to the above equation wherein x is the distance of the pixel (see 
hatched pixel in Fig. 3) from a bottom left hand corner B in the x-direction of the digital image 2 and y is the correspond- 
ing distance in the y-direction. x max and y max are the maximum dimensions of the digital image 2 in the x and y-direc- 

io tion. The digital image 2 is for example generated by a scanner (not shown) which is used to convert visual image 
information of an image frame into the corresponding digital image data of the image frame. It is clear for a person 
skilled in the art that scanner may also be used to scan entire film rolls. Additionally the scanner should not be limited 
to a special film format. 

[0030] Thus, as mentioned previously, f is an unknown parameter, f is regarded as the light falloff correction value 
is and its determination enables the precision of an individual correction value for each pixel value. The following descrip- 
tion provides various possibilities to determine the falloff correction parameter. 

[0031] Firstly, the value of f may be selected in order to approximate the falloff compensation that was implicit in an 
optical photographic system. This means, that the calculating step of the light falloff compensation function fcf is carried 
out with a focal length f of a typical optical photographic printer. Here the light falloff compensation parameter f is equiv- 

20 aient to the focal length f of the optical printer. In a typical optical photographic printer, the image Irradiance at the corner 
54 of the image is approximately 85% of the irradiance at the center 5 of the digital image 2. In order to approximate 
this level of implicit falloff compensation with the method of the present invention, the value of f must be 3.62 * d max , 
where d max is the distance of the image corner to the image center 5 (i.e. x = x max and y = y max ). 
[0032] in addition, the light falloff compensation function fcf is determined by the focal length f of the digital image 

25 capture lens. In order to get the best correction, an operator may simply adjust a slider of a graphical user interface, 
which applies a light falloff compensation function fcf, generated with any number of choices for the focal length f. The 
operator may adjust the slider until he is pleased with the results. The resulting value for the focal length f is served and 
input to the lens falloff function generator 30 as the falloff correction parameter. 

[0033] In addition, f may be defined by the format of a photographic film, the at least one digital image is generated 
30 from. The scanner or digital image generating means may determine format of the photographic film. The film format 
provides information about the camera used for picture taking. For instance, assuming that the film format is known, (i.e. 
APS or 35mm), the value for f may be selected that it is appropriate for a wide variety of camera types of the specified 
format. In general, the value for f appropriate for APS cameras is smaller than the value of f appropriate for 35 mm film 
cameras (see Table 1). 

35 [0034] In addition, if the camera type (i.e. single use camera, point and shoot, single lens reflex) is known, an even 
more appropriate value for f may be chosen. The camera type may be determined by the photographic printer, which 
has means to read or detect camera information somewhere on the photographic film. Additionally, the film rolls 
exposed by the various camera types may be processed on separate printers. This makes it easy to set a special f- 
value for the various camera types (see Table 1 ). For instance, the value of f should be smaller for single use camera 

40 images than single lens reflex cameras, since in general, single use camera lenses have shorter focal lengths than sin- 
gle lens reflex camera lenses. 

[0035] A further possibility to determine the light falloff compensation parameter f for the lens falloff is done by an 
analysis of the pixel values of the images. For example, images on a single roll 12 of a photographic film are analyzed. 
It is assumed that the images are taken with the same imaging device. 

45 [0036] According to this method, an avenge frame for all the frames Fffry), F 2 (x,y),..., F n (x,y) on one roll 1 2 may 
be calculated: A pixel value 65 of a first avenge frame F| at a specific location is computed by averaging together the 
pixel values of all frames at that same location (for example the specific location may the upper right hand corner 60, 
see Fig. 6). Once computed, the first average frame 7^ is forced to have symmetry about a vertical axis 61 and a hori- 
zontal jixis 62 in the following manner. Three more images (averaged frames) are generated from the first average 

so frame by reflecting about the horizontal axis 61 , the vertical axis 62, and both the horizontal and the vertical axes 62 
and 61 respectively. As a result of this process one obtains a second average frame F 2 , which is the first avenge frame 
Fj flipped about the horizontal axis 61 , a third avenge frame F 3 , which is the first average frame Fj flipped about the 
horizontal axis 61 and a fourth average frame F 4 . which is the second average frame F 2 flipped about the vertical axis 
62. The four average frames F^ F 2 , F 3 and F 4 are then averaged together in order to generate a symmetric average 

55 frame Fg. 

[0037] A cos surface is then fit to the symmetric average frame F^. In this regard, many cos f a ||off surfaces are 
generated by varying the parameter f and the offset m in Equation 5. fit(x, y) is comparable to equation 1 . The result of 
the best fit here provides a value for f, the light falloff correction parameter. 
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fit(x.y) = 1 000 log 10 cos 4 ^tan " 1 (jJ +m 



Equation 5 



5 The fit(x,y) which produces the minimum least squared error with reference to the symmetric average frame is the opti- 
mal fit The error E of an ideal cos surface and the symmetric average frame, Fg (x,y) may be calculated wit the fol- 
lowing formula: 

10 E = ZWx,y)-T s (x t y)] ' . 

Xf y Equation 6 

The value of the parameter f used to generate the falloff compensation function fcf is then set to the / which was used 
15 to produce the optimal fit. Search routines and optimization techniques exist that accomplish efficient locations of the 
values of f and m that minimize the least squared error E. 

[0038] Fig. 7 is a graphical representation of intensity distribution (in 1000 x log E) in an average frame. In this spe- 
cific example sub-samples of 64 times 64 pixels are formed from the digital image, which comprises for example 1 024 
times 1536 pixel elements. According to the sub-sampling one ends up with a digital image comprising 16 times 24 
20 image blocks for the average frame. It is clear for a skilled person that other sizes of the sub-samples may be chosen 
and consequently their selection is obvious. The number of image blocks governs the time necessary for any calcula- 
tion. So the fewer the blocks or pixels of an image to be considered the faster the result for the required parameter for 
the falloff compensation function. 

[0039] According to the above sub-sampling the intensity distribution in the symmetric average frame F§ is shown 
25 in Fig. 8. The determination of the average image frame Fg is done with the same size of sub-samples as used in Fig, 
7. The average image frame F§ is fitted to a cos 4 surface in order to provide a fit-parameter f sub . A graphic representa- 
tion of the average image frame Fg fitted to the cos 4 surface is shown in Fig. 9. f sub is related to the parameter f for the 
real image by the size of the sub-samples (for this example: /= 64 x f sub ). The graphical representation of a light falloff 
compensation mask is shown in Fig. 1 0. This is a three dimensional representation of the compensation values, which 
30 are applied to associated pixel values of each image frame on said film roll 1 2, from which the average image ; .frame Fg 
is generated form. 

[0040] Fig. 1 1 is a representation of an image before the compensation for light falloff has been carried out. In con- 
trast to that the compensated image (Fig. 1 2) shows a major improvement in image quality. The image (Fig. 1 1) before 
the compensation is darker at its corners as in its center. This image defect is caused by the discussed light falloff. The 
35 compensation for light falloff furnishes an image, which is free from the light falloff defect. The image (Fig. 12) shows 
an even exposure. The result of compensation as shown in Fig. 12 is done with the above method of generating an 
avenge image frame Tq from a single film roll. 

[0041] Finally, if the source of the image is unknown, then a conservative estimate may be made for the light falloff 
correction parameter f in order to avoid over-compensation. The estimate is done by selecting f such that tfcm (0,0) = 
40 C wherein C is a constant value. In a preferred embodiment the constant C = 150 code values assuming the data 
matrix is 1 000 log Exposure: 

[0042] As mentioned earlier, a further component contributing to the light falloff compensation arises form the light 
falloff caused by the firing of a flash. The flash falloff compensation function, ffcf, is also described as a mathematical 
function of location in the image. In general, the flash falloff compensation function ffcf is of greater magnitude than the 
45 lens falloff compensation function Ifcf (in other words, generally ffcf(0,0)>lfcf(0,0). 

[0043] Flash falloff generally may not be radially symmetric with respect to the center of the image. In the preferred 
embodiment, the flash falloff compensation function ffcf may be described by the following equation 7: 



/fcffA',y; = -[1OOOIog 1o cos 4 0 2 ] Equation 7 

Where: 



55 © 2 = tan 



d 2 = normalized distance from image center 5 to any point in the image plane. d 2 is calculated according to equation 8 
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Equation 8 



10 



f2 = normalized flash failoff correction parameter 



thus, f2 is an unknown parameter. The value used for f2 may be estimated in a number of ways. 



75 



20 



25 



30 



35 



[0044] First of all, if it is known that the flash was not used in capturing the scene passed to the failoff compensator 
10, then the flash failoff compensation function ffcf(x,y) =0 for pixel values pij. This may be accomplished by selecting 
a large value (such as 1000 x d max ) for f2. 

[0045] If the flash was used in the capturing process, then a much lower flash correction parameter f2 is appropri- 
ate. For instance, an image with harsh flash failoff may benefit greatly from a flash correction parameter f2 of 1 .5 x d max . 
For an example, d max is 1 .414, an approximate value of f2 may be 2.1 . 

[0046] Another possibility for obtaining a value for the flash correction parameter f2 is that an operator simply 
adjusts a slider of a graphical user interface which applies a failoff compensation mask generated with light failoff com- 
pensation function with any number of choices for f2. The operator adjusts the slider until he is pleased with the results. 
The resulting value for the f2 is preserved and input to the lens failoff function generator 30. 

[0047] In an alternative embodiment of the present invention, a specific function for the flash failoff characteristics 
may be specified at the time of manufacture of the flash unit. This information, along with the information of whether of 
not the flash was used on a specific frame, may be used to construct a flash failoff compensation mask. Information of 
tat kind may be provided on some recording areas on the photographic film. The printer reads the information and uti- 
lizes it for the calculation of the flash failoff correction parameter f2. 

[0048] A further possibility to calculate the flash failoff correction parameter f2 is determined from an analysis of the 
pixel values of the images captured with the same imaging device. All of the images are captured with the same flash 
fire conditions. In many image capture systems, the scene flash fire condition may be recorded with the scene. In a sim- 
ple case, the Advanced Photo System records with each scene whether the flash was fired or not. The scenes in a com- 
mon order where the flash was fired may be used to generate a symmetric average frame, as previously described. A 
. cos surface may be optimally frtto the symmetric average frame by minimizing the squared error between the sym- 
metric average frame and the cos surface. The value of f t that generates the optimal fit may be used as the flash cor- 
rection parameter f2 in the flash failoff compensation function ffcf. 

[0049] The flash failoff compensation function ffcf and the lens failoff compensation function Ifcf are fed to an adder 
50. Thus, the light failoff compensation function, fcf, is expressed mathematically in equation 9, wherein equation 9 is 
valid for all pixels of the digital image 2. 



fcf(x,y) = lfcf(x,y) + ffcf(x f y) 



Equation 9 



[0050] In an alternative embodiment of the present invention, the image data metric may be linearly related to expo- 
45 sure of the scene. In this embodiment, the calculation of the light failoff compensation function fcf is shown in equation 
10. 



fcf(x, y) = Ifcf (x, y) x ffcf (x, y) 



Equation 10 



so where: 



lfcf(x,y) = 



cos 4 e 
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and 
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5 [0051] The definitions of © and 0 2 remain the same as described above, and the selection or determination of B 
and C-) 2 also remain identical to the above methods. 

[0052] According to another possibility, the light falloff compensation function, fcf(x,y) may be equal to only the lens 
falloff compensation function, ffcf(x,y). In order to compensate for flash falloff in this embodiment, the value of f 2 is 
decreased. Thus, in this embodiment, the combination of lens and flash falloff is modeled simply as a more severe case 

10 of lens falloff than is actually the case. 

[0053] In one embodiment of the invention the method for compensating digital images may encompass additional 
steps to provide an output of an image, which is compensated for light falloff. The inventive method comprises several 
steps. At first, providing a plurality of pixel values, which are generated from at least one conventional photographic 
frame or digital image. Also a light falloff compensation function fcf is provided. The light falloff compensation function 

75 fcf is constituted by a two-dimensional function (see Equation 1 or 5). The equations include both an unknown param- 
eter /. The specification above shows numerous possibilities for generating, determining or choosing a value for the so- 
called light falloff correction parameter. According to the selection of the light falloff correction parameter and the light 
falloff compensation function fcf, a compensation value may be generated for each pixel value of the original image. In 
order to further improve the outcome of the compensation for light falloff, a compensation for non-linearities in the 

20 response of the imaging device is carried out. The correction for non-linearities in the response of the imaging device 
may be necessary. A method of correcting for the non-linearities in the response of photographic film may be imple- 
mented if the digital image is of film origin. Such a-method is described in U.S. Patent 5,134,573 by Goodwin. Such a 
method is performed prior to the application of the light falloff compensation mask.. 

[0054] A further step of the inventive method is to estimate balance and tonal modifications, which are required by 
25 a digital image. There are also two modifications. Firstly, the application of the light falloff compensation mask is per- 
formed prior to estimating the balance of the digital image. This balance could for instance be obtained with an auto- 
matic exposure determination algorithm (such as are used in high speed optical printers or in a Photo-CD scanner, see 
for example U.S. Patent 4,945,406). In the preferred embodiment, the desired level of exposure is determined from an 
image which been modified by the falloff correction. Secondly, the application of the light falloff compensation mask is 
30 performed prior to estimating the tonal modifications required by the digital image. The contrast of the image may be 
estimated by an automatic algorithm. In addition, the contrast of the digital image may likewise be modified to a pre- 
ferred level of contrast. An example of an algorithm that estimates image contrast and provides a means of adjusting 
the contrast of the image is described in U.S. Patent 5,822,453, by Lee and Kwon. In the preferred embodiment, such 
an algorithm would operate on an image which has been modified by the falloff correction. 

35 

Claims 

1 . A method for compensating at least one digital image for light falloff comprising the steps of 

40 providing a plurality of pixel values for each of at least one digital image; 

providing a light falloff compensation function; 
determining a light falloff correction parameter; 

using the light falloff compensation function and the light falloff correction parameter to generate a individual 
compensation value for at least one pixel value; and 
45 applying the individual compensation value to at least one pixel value. 

2. A method as recited in claim 1 wherein the step of applying the individual compensation value to each pixel value 
is additive. 

so 3. A method as recited in claim 1 wherein the step of applying the individual compensation value to each pixel value 
is multiplicative. 

4. A method as recited in claim 1 , wherein the determining step of the light falloff correction parameter is governed by 
a focal length of a digital image capture lens. 

55 

5. A method as recited in claim 1 , wherein the determining step of the light falloff correction parameter is carried out 
■ with a focal length of a typical optica! photographic printer. 
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6. A method as recited in claim 1, wherein the determining step of the light falloff correction parameter is governed by 
a format of a photographic film from which the at least one digital image is generated from. 

7. A method as recited in claim 1 , wherein the determining step of the light falloff correction parameter is governed by 
5 a camera type which is used to take the picture from which the at least one digital image is generated from. 

8. A method as recited in claim 7 wherein the camera type comprises a single use camera wit a 35mm film, a single 
use camera of the Advanced Photo System, a view finder camera for a 35mm film, a view finder camera of the 
Advanced Photo System, a single lens reflex camera with a 35mm film, a single lens reflex camera of the Advanced 

w Photo System, a point and shoot camera with 35mm film or a point and shoot camera of the Advanced Photo Sys- 
tem. 

9. A method as recited in claim 1 , wherein the determining step of the light falloff correction parameter is carried out 
by an analysis of the pixel values of the digital image. 

15 

10. A method as recited in claim 1 , wherein the determining step of the light falloff correction parameter is carried out 
by an analysis of the pixel values of the images captured on a single roll of film with the same imaging device. 

1 1 . A method as recited in claim 1 , wherein the step of the light falloff correction parameter is carried out by an analysis 
20 of the pixel values of the images captured with the same imaging device, wherein all of the images are captured 

with the same flash fire conditions. 

12. A method as recited in claim 1 , wherein the step of applying the individual compensation value is preformed after 
compensating for non-linearities in the response of the imaging device. 

25 

13. A method as recited in claim 1 comprises the additional step of estimating the balance and tonal modifications 
required by the digital image. 

14. A method as recited in claim 13, wherein the step of applying the individual compensation value is preformed prior 
30 to estimating the balance of the digital image. 

15. A method as recited in claim 13, wherein the step of applying the individual compensation value is preformed prior 
to estimating the tonal modifications required by the digital image. 

35 1 6. An apparatus for compensating at least one digital image>or light falloff comprises: 

a digitizing device to provide at least one digitized image frame; 

a light falloff compensator for applying an individual compensation value to at least one pixel element; 
a falloff mask generator using a light falloff compensation function and a light falloff correction parameter to 
40 generate the individual compensation value for at least one pixel element; and 

a rendering device for providing a visual representation of an image compensated for light falloff. 

17. The apparatus as recited in claim 1 6 wherein the light falloff correction parameter is determined by the focal length 
of the digital image capture lens. 

45 

18. The apparatus as recited in claim 16 wherein the light falloff correction parameter is carried out with a focal length 
of a typical optical photographic printer. 

19. The apparatus as recited in claim 16 wherein the light falloff correction parameter is determined by a photographic 
so film format from the at least one digital image is generated. 

20. The apparatus as recited in claim 1 6 wherein the light falloff correction parameter is determined by a camera type 
which is used to take the picture from which the at least one digital image is generated. 

55 21. The apparatus as recited in claim 20 wherein the camera type comprises a single use camera with a 35mm film, a 
single use camera of the Advanced Photo System, a view finder camera for 35mm film, a view finder camera of the. 

22. The apparatus as recited in claim 16 wherein the light falloff correction value is determined by an analysis of the- 



10 
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pixel values of the digital image. 

23. The apparatus as recited in claim 16 wherein the light falioff correction parameter is determined by an analysis of 
the pixel values of the images captured on a single roll of film with the same imaging device. 

24. The apparatus as recited in claim 16 wherein the light falioff correction parameter is determined from an analysis 
of the pixel values of the images captured with the same imaging device, wherein all of the images are captured 
with the same flash fire conditions. 
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(54) A method for compensating digital images for light falloff and an apparatus therefor 



(57) A method for compensation at least one digital 
image for light falloff. The digital image may be gener- 
ated for example from a conventional image frame on a 
film roll. A plurality of pixel values is provided for each 
of at least one digital image. A light falloff compensation 
function is applied and according to tat a light falloff cor- 
rection parameter is determined. Both the light falloff 



compensation function and the light falloff correction pa- 
rameter are used to generate an individual compensa- 
tion value for each pixel element. The compensation val- 
ue is applied to each pixel element. The method is also 
able to differentiate and correct the images according to 
light falloff generated by pure lens falloff or a light falloff 
generated by the lens and the flash falloff. 
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